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APPARATUS AND METHOD FOR ORGANIZATION AND INTERPRETATION 
OF MULTIMEDIA DATA ON A RECORDING MEDIUM 

i> 

Technical Field 

The present invention relates to an apparatus and method for providing multimedia data, 
and a recording medium on which the method is recorded. More particularly, the present 
invention is directed to manage various kinds of multimedia data in the form of 
MusicPhotoVideo (hereinafter, referred to as *MPV') format and to provide the multimedia data 
to users. MPV is an industry specification for multimedia titles, which was announced in 
November 2002 by the Optical Storage Technology Association (established by optical storage 
device manufacturers and hereinafter referred to as 'OSTA'). MPV is a standard for more 
conveniently providing users with various kinds of music, photo and video content or allowing 
users to handle and process multimedia data. The definitions and other standards on MPV are 
available firom the official OSTA web site. 

Background Art 

To execute a variety of existing audio, video and image files, application programs for 
the respective files are reqiiired. Even though there exist application programs for executing 
different formats of multimedia data files, they are applied to only the multimedia data files 
wifliin a limited range. As a result, these application programs have a limitation in allowing users 
to execute multimedia data while maintaining their compatibility between various kinds of 
multimedia data. 

On the other hand, MPV supports a fianction of managing various file associations using 
XML (Extensible Markup Language) metadata so as to reproduce various kinds of multimedia 
data recorded on a storage medium according to the intention of the users. In particular, MPV 
supports JPEQ MPS, WMA, WMV, MPEG-1, MPEG-2 and MPEG-4 as well as the digital 
camera formats of AVI and QuickTime MJPEG video. Fxirther, an MPV standard disk is 
compatible with ISO9660 level 1, Joliet, multi-session CDs, DVDs, memory cards, hard disks 
and the Internet. Thus, MPV allows users to manage and process a wider variety of multimedia 
data. However, the specifications for MPV format require a greater number of elements for 
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specifying formats of multimedia data that were not defined in the specifications (hereinafter, 
referred to as 'asset'). Even in the method of providing various multimedia data to the users, it is 
required that various display fiinctions for the mxiltimedia data be added. 

Disclosure of Invention 

Accordingly, the present invention is conceived to solve the problems in the related art. 
Accordingly, the present invention aims to allow MPV formats to be utilized in various manners 
by proposing multimedia elements for new multimedia data in addition to various kinds of 
multimedia elements currently proposed by the MPV formats and more variously providing 
users with multimedia data in an MPV format. 

According to an aspect of the present invention for achieving the object, there is 
provided an apparatus for displaying multimedia data , to be described in a format of 
MusicPhotoVideo(MPV), wherein, when an asset selected by a user is comprised of a single 
audio data and at least one or more image data, the audio data is provided and at least one or 
more image data are subsequently displayed according to a predetermined method while the 
audio data is being provided. Preferably, the predetermined method comprises the step of 
displaying the image data according to time information indicating the time during which each 
piece of the image data is displayed while the audio data is being provided. Also preferably, the 
predetermined method further comprises the step of not displaying the image data when no time 
information exists. 

According to another aspect of the present invention, there is provided a method for 
displaying multimedia data described in a format of MusicPhoto\^deo (MPV), comprising the 
steps of (1) ascertaining whether an asset selected by a user is comprised of a single audio data 
and at least one or more image data, (2) extracting firom the asset reference information for 
providing the audio data and the image data if the asset is comprised of a single audio data and at 
least one or more image data, (3) extracting and providing the audio data by use of the reference 
information, and (4) extracting at least one or more image data by use of the reference 
information and displaying them sequentially according to a predetermined method while the 
audio data is being provided. Preferably, the predetermined method comprises the step of 
displaying the image data according to time information indicating the time during which each 
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piece of image data is displayed while the audio data is being provided. Also preferably, the 
predetermined method furfh©- comprises the step of not displaying the image data when no time 
information exists. 

According to a further aspect of the present invention, there is provided a method for 
displaying mviltimedia data, to be described in a format of MPV, comprising the steps of 
ascertaining whether an asset selected by a user is comprised of a part of a single audio data, 
extracting from the asset reference information for providing the part of the single audio data if 
the asset is comprised of a part of a single audio data, and providing the part of the single audio 
data by use of the reference information according to a predetermined method. Preferably, the 
predetermined method uses location information on the provided part of the audio data, the 
location information comprising location information relative to time when the audio data is 
played. Also preferably, the location information on time comprises time information indicating 
a start time for playing the audio data, time information indicating the time dxmng which the 
audio data is being played, time information indicating a stop time when playing of the audio 
data is terminated, or a combination of two or more of the time information. 

According to a still further aspect of the present invention, there is provided a method 
for displaying multimedia data, to be described in a format of MPV, comprising the steps of 
ascertaining whether an asset selected by a user is comprised of a part of a single video data, 
extracting from the asset reference information for providing the part of the single video data if 
the asset is comprised of a part of a single video data, and displaying the part of the single video 
data by use of the reference information according to a predetermined method. Preferably, the 
predetermined method uses location information on a displayed part of the video data, the 
location information comprising location information relative time when the video data is played. 
Also preferably, the location information on time comprises time information indicating a start 
time for displaying the video data, time information indicating the time during which the video 
data is being displayed, time information indicating a stop time when displaying of the video 
data is terminated, or a combination of two or more of the time information. 

According to another aspect of the present invention, there is provided a recording 
medium on which a program for displaying multimedia data to be described in a format of MPV 
is recorded, wherein the program ascertains whether an asset selected by a user is comprised of a 
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single avidio data and at least one or more image data, extracts reference infonnation from the 
asset for providing the audio data and the image data where the asset selected by the user is 
comprised of a single audio data and at least one or more image data, extracts and displaying the 
audio data by use of the reference infomiation, and allows at least one or more image data to be 
extracted by use of the reference information and then displayed sequentially according to a 
predetermined method while the audio data is being provided, the predetermined method 
comprising displaying the image data according to time infonnation indicating the time that each 
piece of image data is displayed while the audio data is being provided. 

According to a further aspect of the present invention, there is provided a recording 
medium on which a program for displaying multimedia data to be described in a format of MPV 
is recorded, wherein the program ascertains whether an asset selected by a user is comprised of a 
part of a single audio data, extracts reference information from the asset for providing the part of 
the audio data where the asset selected by the user is comprised of a part of the single audio data, 
provides the part of the audio data by use of the reference information according to a 
predetermined method, the predetermined method comprising displaying the provided part of the 
audio data by use of location infomiation on the provided part of the audio data. 

According to a still further aspect of the present invention, there is provided a recording 
medium on which a program for displaying multimedia data to be described in a format of MPV 
is recorded, wherein the program ascertains whether an asset selected by a user is comprised of a 
part of a single video data, extracts reference information from the asset for providing the part of 
the video data where the asset selected by the user is comprised of a part of the video data, 
displays the part of the video data by use of the reference information according to a 
predetmnined method, the predetermined method comprising displaying the provided part of the 
video data by use of location information on the provided part of the video data. 

Brief Description of Drawings 

The above and other objects, features and advantages of the present invention will be 
apparent from the following detailed description of the preferred embodiments of the invention 
in conjunction with the accompanying drawings, in which: 

FIG 1 is a block diagram illustrating the configuration of an apparatus for providing 
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multimedia data according to the present invention; 

FIG 2 is a view illustrating the structure of an application program implemented by a 
method of providing multimedia data according to the present invention; 

FIG 3 is a view illustrating a state where multimedia data are displayed in accordance 
with xiser*s function setting \ising the application program implemented by the method of 
providing multimedia data according to the present invention; 

FIGS. 4 to 8 are views illustrating a variety of transitions according to the present 
invention; 

FIG 9 is a flowchart illustrating a method of providing multimedia data according to an 
embodiment of the present invention; 

FIG 10 is a flowchart illustrating processing steps from displaying a thumbnail grid to 
waiting for a user action according to an embodiment of the present invention; and< 

FIG 1 1 is a flowchart illustrating a process of executing a slideshow according to an 
embodiment of the present invention. 

Best Mode for Carrying out the Invention 

Hereinafter, an apparatus and method for providing multimedia data using an MPV 
format according to preferred embodiments of the present invention will be explained in detail 
with reference to flie accompanying drawings. 

In general, the present invention employs XML (Extensible Marlcup Language) to 
provide multimedia data in an MPV format, and will be hereinafter described in accordance with 
an XML-schema. 

The present invention presents six new elements such as 'Audio WithStiir, 'AudioPart*, 
•VideoPart*, 'AudioWitiiStilsRef , 'AudioPartRef and VideoPartRef , which are not defined by 
OSTA, so as to provide various multimedia data. The definitions and practices of usage for the 
six new elements will be discussed. 

1. 'AudioWitiiStiir element 

The 'AudioWithStiir element is an element in which a single audio asset is grouped with 
one or more still assets. The still assets usually employ an image file of a screen resolution. The 
'AudioWitiiStiir element can be defined in accordance with the XML-schema, as follows: 
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(1 ) element mpv: AudioWithStill, complexType mpv: Audio WithStillType 

(2) namespace http://samsung.co.kr/digitalmediaRd/avstation2 

(3) type SMPV: AudioWithStillType 

(4) children 

mpv:ContentID, mpviDocumentID, mpv:InstanceID, mpvrMetadata, 
nmfrMetadata, mpvrStillRefs, mpv:AudioRef, SMPV:DisplayTime, 
mpv:Related, mpv:Rendition 

(5) attributes 

Name Type Use Default Fixed 
mpv:id xs:ID 

(6) source <xs:element name=" AudioWithStill" type="SMPV: AudioWithStillType" 
substitutionGroup="mpv:CompositeAssetBase"/> 

source <xs:complexType name="AudioWifliStillType"> 
<xs:complexContent> 

<xs:extensionbase="mpv:CompositeAssetBaseType"> 
<xs:sequence> 

<xs:element ref="mpv:StillRef' maxOccurs="unboimded"/> 
<xs:element ref="mpv:AudioRef' /> 

<xs:element name-' DisplaySchema " type="xs:string" minOccurs="0"/> 

<xs:group ref="mpv:RelationsElemGroup"/> 

</xs:sequence> 

</xs:extension> 

</xs:complexContent> 

</xs:complexType> 

The attribute value of the 'DisplayTime' element indicates flie dxiration of the each 
still asset , in seconds . The attribute value of 'DisplayTime' always includes a relative time, 
which can be represented as a decimal point. If the attribute value of 'DisplayTime' is 
unspecified, the assumption is that there is no display duration. The definitions for the 
'DisplayTime* element can be summarized as follows. 

DisplayTime = <clock-value> (";"<clock-value>)* 
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clock-value = (<seconds> | <uiiknown-d\ir>) 
\jnknown-dur = the empty string 
seconds = <decimal number> ("."<decimal number>)? 
decimal-number = [0-9] [0-9]* 

The usage of the 'DisplayTime' element will be described. The attribute value of the 
'DisplayTime' element of 3' means that a still asset is displayed for 3 seconds, and the attribute 
value of the 'DisplayTime' element of *3;5* means that a first still asset is displayed for 3 seconds 
and a second still asset is displayed for 5 seconds. Meanwhile, if the attribute value of the 
'DisplayTime' element of '3.5;6;2.7' means that first to third still assets are displayed for 3.5 
seconds, 6 seconds and 2.7 seconds, respectively. 

2. 'AudioPart' element 

An AudioPart' element specifies a part of an audio asset. The AudioPart* element can be 
defined in accordance with the XML-schema, as follows: 

(1 ) namespace http://samsung.co.kx/digitalmediaRd/avstation2 

(2) typeSMPV: AssetPartBaseType 

(3) children 

mpv:Metadata, rmifiMetadata, SMPV:start, SMPV:stop, SMPV:dur, mpv:AudioRef 

(4) attributes 

Name Type Use Default Fixed 

manifestLinklDRef xsiNCName optional 

listlDRef xs:NCName optional 

mpviid xs:ID 

idRef xs:NCName required 

<xs:complexType name=" AudioPart "> 

<xs:complexContent> 

<xs:sequence> 

<xs:element ref="mpv:Metadata" minOccurs="0"/> 
<xs:element ref="nmf:Metadata" minOccurs="0"/> 
<xs:elementref="SMPV:start" minOccurs="0"/> 
<xs:elementre5="SMPV:stop" minOccurs="0"/> 
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<xs:element ref="SMPV:diir " minOccurs="0'V> 

<xs:element ref="mpv:AudioRef ' minOcciirs="rV> 

</xs:sequence> 

</xs:complexContent> 

</xs:complex'IVpe> 

The *manifestLinkIDRef specifying an attribute of the *AudioPart' element provides a 
value of the ID (mpvrid) of a ManifestLink* asset containing a referenced asset. When no 
'manifestLinklDRef is present, a current manifest ('manifest* means 'OSTA XML MANIFEST) 
is used. 

Meanwhile, the listlDRef provides a value of the ID (mpv:id) of an 'AssetList' or 
*MarkList' containing a referenced asset. When no listlDRef is present, the 'AssetList' in the 
same manifest is used. 

Further, the *idRef provides a value of the ID (mpv:id) of a referenced asset. When no 
'listlDRef is present, the 'AssetList' in the current manifest is used. When no 'manifestLinklDRef 
is present, the current manifest is used. 

Furthermore, the 'SMPV:start*, 'SMPVrstop' and 'SMPV:dur' are defined as lower 
elements of the AudioPart' element. At least one of the three lower elements mxist be assigned 
with its attribute value. 

The 'SMPVistart' element can be defined as <xs:element name="SMPV: start" type= 
"xsilong" minOccurs="0"/>. This element identifies a start time in seconds related to the 
beginning of the referencing asset. When this attribute is unspecified , it is assumed that the start 
time can be calculated based on the attribute values of SMPV:stop' and 'SMPVidxir' as [ SMPV: 
start] = [ SMPV: stop] - [ SMPV: dur]. In a case where the attribute value of ' SMPV: stop' or ' 
SMPV: dur' is unspecified, the attribute value of SMPV: start' is equal to 0. 

The 'SMPV:stop' element can be defined as <xs:element name="SMPV:stop" 
type="xs:long" minOccurs="0"/>. This element identifies a stop time in seconds related to the 
beginning of the referencing asset. When any value is un specified, it is assumed that the stop 
time can be calculated based on the attribute values of ' SMPV: start' and ' SMPV: duf as 
[ SMPV: stop] = [ SMPV: start] + [ SMPV: dur]. In a case where ' SMPV: dur' is unspecified 
while the attribute value of ' SMPV: start' is given, ttie attribute value of SMPV: stop' is equal to 
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the duration of the referenced asset. On the other hand, in a case where ' SMPV: start* is 
unspecified while the attribute value of SlsdPV: dur* is given, the attribute value of* SMPV: stop* 
is equal to a value of * SMPV: dur'. 

The *SMPV:dur' element can be defined as i<xs:element name="SMPV:dur" 
type="xs:long" niinOccurs="0"/>. This element identifies the duration of the firagment related 
to the referenced audio asset. When the attribute value of ' SMPV:dur* is un specified, it is 
assumed that the duration can be calculated as [ SMPV: dur] = [ SMPV: stop] - [ SMPV: start]. In 
a case where the attribute value of ' SMPV: stop' or * SMPV: dur" is unspecified, the value of ' 
SMPV: dur' is not defined. 

3. VideoPart' element 

The VideoPart* element specifies a part of a video asset. The 'VideoPart* element can be 
defined in accordance with the XML-schema, as follows: 

(1) namespace http://samsxmg.co.kr/digitalmediaRd/avstation2 

(2) type SMPV: AssetPartBaseType 

(3) children 

mpv:Metadata, nmfiMetadata, SMPVstart, SMPVstop, SMPVdur, mpv: VideoRef 

(4) attributes 

Name Type Use Default Fixed 

manifestLinklDRef xs:NCName optional 

listlDRef xs:NCName optional 

mpv:id xs:ID 

idRef xs:NCName required 

xs:complexType name='*VideoPart **> 

<xs:complexContent> 

<xs:sequence> 

<xs:element ref="mpv:Metadata** minOccurs="0"/> 
<xs:element ref=="nmf:Metadata" minOccurs="0"/> 
<xs:element ref=*'SMPV:start" minOccurs="0"/> 
<xs:element ref="SMPV:stop" minOccurs=*'0"/> 
<xs:element ref="SMPV:dur '* minOccurs="0"/> 
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<xs:element re^"mpv: VideoRef * minOccurs=" 1 "/> 

</xs:sequence> 

</xs:complexContent> 

<yxs:complexType> 

4. 'AudioWithStilsRef element 

The 'AudioWithStilsRef element references the 'AudioWithStiir element The 
'AudioWithStilsRef element can be defined in accordance with the XML-schema, as 
follows: 

(1) Attributes 

Name Type Use Defavilt Fixed 

manifestLinklDRef xsiNCName optional 

listlDRef xsiNCName optional 

mpv:id xs:ID 

idRef xsiNCName required 

5. 'AudioPartRef element 

The 'AudioPartRef element references the AudioPart' element. The AudioPartRef 
element can be defined in accordance with the XML-schema, as follows: 
(1) Attributes 

Type Use Default Fixed 

xs:NCName optional 
xs:NCName optional 
xs:ID 

xsiNCName required 
The 'manifestLinklDRef specifying the attribute of the AudioPartRef element 
provides a value of the ID (mpv:id) of the 'ManifestLink* asset containing the referenced 
asset. When no ' manifestLinklDRef ' is present, a current manifest (the 'manifest' means ' 
OSTA XML MANIFEST) is used. 

Meanwhile, the 'listlDRef provides a value of the ID (mpv:id ) of the ' AssetList ' or 
' MarkList ' contain ing the referenced asset When no ' listlDRef is present, the ' AssetList ' 
in the same manifest is used. 



Name 

manifestLinklDRef 

hstlDRef 

mpviid 

idRef 
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Further, the 'idRef provides a value of the ID (mpv:id ) of the referenced asset. 
When no * hstlDRe f is present, the * AssetList ' in the current manifest is used. When no ' 
manifestLinklDRef • is present, the cxirrent ' manifest ' is used. 

6. VideoPartRef element 

The VideoPartRef element references the VideoPart' element. The 'VideoPartRef 
element can be defined in accordance with the XML-schema, as follows: 
(1) Attributes 

Name Type Use Default Fixed 

manifestLinklDRef xs:NCName optional 

listlDRef xsrNCName optional 

mpv:id xs:ID 

idRef xs:NCName required 

The method of providing the user with multimedia data using the new elements 
presented above can be expressed into XML, as follows. For the sake of convenience, the 
•AudioPart* element of the six new elements will be taken as an example. 

Example) 

01 -<mpv: Audio mpv:id="D000100"> 

02 - <mpv:LastURL>music.mp3</mpv:LastURL> 

03 - </mpv: Audio> 

04 - <SMPV:AudioPartmpv:id="D0001001"> 

05 - <mpv:AudioRef mpv:idRe^"D000100"/> 

06 - <SMPV:start>2</SMPV:start> 

07 - <SMPV:stop>7</SMPV:stop> 

08 - </SMPV: AudioPart > 

09 - <SMPV: AudioPart mpv:id="D0001002"> 

10 - <mpv:AudioRef mpv:idRef="D000100/"> 

11 -<SMPV:start>2<;/SMPV:start> 

12 . <SMPV:dur>5</SMPV:dur> 

1 3 - </SMPV: AudioPart> 

14 - <SMPV:AudioPartmpv:id="D0001002"> 
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15 - <mpv:AudioRef mpv:idRef="D000100"/> 

16 - <SMPV:stop>7</SMPV:stop> 

1 7 - <SMP V:diir>5</SMP V:dur> 

18 - <ySMPV:AudioPart> 

In the example, W to *03* indicate that an ID of the 'Axidio' asset proposed in the 
MPV format standards is set to TOOOOlOO' and an audio file corresponding to the actual 
'Audio' asset is set to 'music.mpS'. 

Further, in the example, '04' to '08' indicate that the ID of the 'AudioPart' asset 
according to the present invention is set to 'IDOOOlOOr and the referenced 'Audio' asset is set 
to 'music.mp3' corresponding to the ID 'EDOOOIOO'. At this time, it indicates that the music is 
played fi-om 2 to only 7 seconds after the start point thereof in the entire length where the 
'music.mpS' is played. 

Further, in the example, '09' to '13' indicate that the ID of the 'AudioPart' asset 
according to the present invention is set to 'ID0001002' and the referenced 'Audio' asset is set 
to "musicmpS' corresponding to the ID 'IDOOOlOO'. At this time, it indicates that the music is 
played for 5 seconds firom 2 seconds after the start point thereof in the entire length where 
the 'music.mp3' is played. 

Furthermore, in the example, '14' to '18' indicate that the ID of the 'AudioPart' asset 
according to the present invention is set to 'ID0001002' and the referenced 'Audio' asset is set 
to 'music.mpS' corresponding to the ID 'EDOOOIOO'. At this time, it indicates that the music is 
stopped at a time of 7 seconds after the start point of the music but for 5 seconds before the 
stop of the music in the entire length where the 'music.mp3' is played, i.e. the music is played 
from 2 seconds to 7 seconds after the start of the music. 

FIG 1 is a block diagram illustrating the configuration of an apparatus 100 for 
providing multimedia data according to the present invention. The apparatus 100 of the 
present invention comprises a display unit 110 for selectively providing a first display mode 
in which only one multimedia data selected by a user is displayed among a plurality of 
multimedia data in the MPV format classified by the user, and a second display mode in 
which the plurality of classified multimedia data are sequentially displayed (hereinafter, 
referred to as 'transitioned'); a user input unit 130 for selecting the display modes; and a 
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control unit 120 for transferring, to the display unit, the display mode corresponding to 
control information input by the user input unit. At this time, a fiinction of magnifying, 
reducing or rotating the displayed multimedia data, e.g. the image data, is provided when flie 
first display mode has been selected by user input 140, while a function of sequentially 
transiting the plurality of multimedia data according to the data transition duration and tiie 
data display dxiration selected by the user is provided when the second display mode has 
been selected. Meanwhile, the multimedia data in ttie MPV format can be described in the 
form of an XML document, and be converted into a pliirality of application documents 
depending on stylesheets applied to the XML document. According to the present invention, 
users can manage multimedia data through their browser by using the stylesheets for 
converting the XML documents into the HTML documents. Furthermore, the users can 
access multimedia data in MPV format through mobile terminals such PDAs, cellular 
phones, and smart phones by using the stylesheets for converting XML documents into 
WML and cHTML (compact HTML) documents. 

FIG 2 is a view illustrating a preferred embodiment of an application program 
implemented by a method of providing multimedia data according to the present invention. 
Referring to FIG 2, t he application program 200 may include a presentation area 210, a 
control area 220 and a thumbnail area 230. In the thumbnail area 230, multimedia data 
previously classified by the viser are provided. In the presentation area 210, multimedia data 
selected by the user in the thumbnail area are magnified and shown in the form of screen 
images, or multimedia data displayed in the thumbnail area are sequentially shown to the 
users in the form of slides. In the control area 220, the screen control of multimedia data 
displayed in the presentation area 210 is performed. For example, in a case where a plurality 
of image data are to be consecutively displayed, the display of image data is paused, the 
transition duration firom one image data to next image data is set, or the display duration for 
one of the image data is set. 

FIG 3 is a view illustrating a state where a plurality of multimedia data are 
sequentially displayed in a presentation area 310 of an application program implemented by 
the method of providing mviltimedia data according to the present invention. A control area 
320 is provided with a function of allowing the transition duration for the multimedia data 
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and the display duration for one mxiltimedia data to be set by the user input. Referring to FIG 
3, the transition duration is set to 2 seconds as 'Transition duration', and the display duration 
is set to 2 seconds as 'Display duration'. Meanwhile, in the presentation area 310, it is shown 
that the sequential multimedia data are partially transited from the bottom right comer of the 
presentation area. This transition function is defined in SMPTE (Society of Motion Picture 
and Television Engineers). In the present invention, the transition function of transitioning 
the multimedia data in the MPV format using XML metadata is provided. 

FIGS. 4 to 8 illustrate a variety of transition functions , according to the present 
invention. FIG 4 shows a state where the next multimedia data appear while the previous 
multimedia data fade, FIG 5 shows a state where the next multimedia data appear from the 
top right comer of the presentation area 310, FIG 6 shows a state where the next multimedia 
data appear outwardly from the center of the presentation area 310, FIG 7 shows a state 
where the multimedia data are transitioned in the form of grids in the presentation area 310, 
and FIG 8 shows a state where the next multimedia data appear horizontally from the center 
of the presentation area 310. 

The algorithms for implementing the functions shown in FIGS. 2 to 8 according to 
the preferred embodiments of the present invention can be stepwise expressed as follows: 

Step 1 . Initialize the SMP V document 

Step 2. Create the list of pointers to the asset objects 

Step 3. Display the thvimbnail grid 

Step 4. Get the user action classified into Steps 5, 6 and 7 

Step 5. Open an album 

Step 6. Display screen rendition 

Step 6.1. Display the "option". 
Step 6.1.1, Zoom 
Step 6.1.2. Rotate 

Step 7. Start a slideshow 

Step 7.1. Display slideshow controls 
Step 7.1.1. Pause slideshow 
Step 7.1.2. Stop slideshow 
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Step 7, 1 .3. Display options 

Step 7.1.3.1. Change display duration/transition duration 
Step 7.1.3.2. Apply changes 
Step 7.1.3.3. Close options 
Step 7.2. Run slideshow 
Step 8. Display the next asset 

Meanwhile, Tables 1 to 3 indicate function names for special classes used for 
implementing the algorithms, description on the functions, and steps in which respective 
functions are used. 

Table 1. Class Name: Executer 



Fimction Name 


Description 


Step Where Function Is 
Used 


OpenDocument(strFileName) 


Open mpv document 


Step 1 


GetResourceListO 


Create resource list 


Step 2 


GetAlbumO 


Retum pointer to album 


Step 3, Steps 


GetResourceList( Album) 


Create resource list used in 
album 


Step 3, Step 5 


ExecuteSlideshowO 


Execute slideshow 


Step 7.1 
Step 7.1.3.2 


StartSlideshowQ 


Start slideshow 


Step 7 


StopSlideshowQ 


Stop slideshow 


Step 7.1.2 


SettingsO 


Display slideshow's settings 


Step 7.1.3 


HideSettmgsO 


Hide slideshow's settings 


Step 7.1.3.3 


PauseSKdeshowQ 


Pause slideshow 


Step 7.1.1 


ChangeDurationsO 


Change transition/display 
durations 


Step 7.1.3.1 


Showhnage(srcpath,name) 


Display asset 


Step 6 
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Table 2. Class Name: Asset 



Function Name 


Description 


Step Where Fvinction Is 
Used 


Asset(type, reflD, doc) 


Initialize asset object 




GetThumbnailRenditionNTFS 
LastURL 


Return path to thxunbnail 
rendition 


Step 3 


GetScreenRenditionNTFSLast 
URL 


Return path to thumbnail 
rendition 


Step 6 


NTFSLastURL 


Retum path to asset itself 


Step 3 


ThumbnailRend 


Retum thumbnail rendition 


Step 3 


ScreenRend 


Retum screen rendition 


Step 6 


Rendition (value) 


Retum rendition 


Step 3 


GetRefID 


Retum reference ID 


Step 3 


GetClassName 


Retum asset class 


Step 3 


Table 3. Class Name: AssetRef 


Function Name 


Description 


Step Where Function Is 
Used 


AssetRef(node) 


Initialize reference asset object 


Step 2 


IsTransition 


Retum tme if transition is 
defined 


Step 7.2 


TransitionType 


Retum transition type 


Step 7.2 


TransitionSubType 


Retum transition subtype 


Step 7.2 


TransitionDur 


Retum transition duration 


Step 7.2 


Transitionldx 


Retum transition index 


Step 7.2 



Meanwhile, FIG 9 shows a flowchart illustrating the steps of implementing the 
method of providing multimedia data according to the present invention. The SMPV 
document in the MPV format that contains new elements of the present invention is first 
initialized (S901). The list of pointers to the asset objects is then created (S903). After the 
thumbnail gird is displayed (S909), the process waits for a user action (S907). If the user 
selects a new album, the new album is opened (S91 1), and then, the process returns to step 
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S901 of initializing the SMPV document. If the user displays the screen rendition (S921), a 
function capable of controlling the screen rendition is provided (S923). Then, depending on 
the user's action, the zoom function may be performed (S929), the rotation fimction may be 
performed (S927) or the next asset may be displayed (S963). On the other hand, if the user 
selects a slideshow, the sUdeshow starts (S941). At this time, a function capable of 
controlling the slideshow is provided (S943) while the slideshow is executed (S945). Then, 
the user may pause the slideshow (S949) or stop the slideshow (S961). Altematively, the user 
may select the 'option' menu (S951) to change the transition and display dxirations (S953) 
and to apply the changes thus made (S959). Therefore, the user can execute the slideshow in 
accordance with the changed transition and display durations. 

FIG 10 is a flowchart specifically illustrating the process fi-om displaying the 
thumbnail grid in step 3 to waiting for user actions in step 4 according to the present 
invention. After the thumbnail grid is displayed (SI 010), the Hst of the assets is requested 
(S1015). Then, asset types for all the assets in the Kst are obtained (S1020), and they are 
checked (SI 025). According to the asset types, the thumbnail rendition is displayed (SI 030), 
a document icon is obtained (SI 035), an album icon is obtained (SI 040) or a sound icon is 
obtained (SI 045). Thereafter, HTML is created (SI 050) and the event handler is then 
registered (SI 055). Then, the process waits for a user action (SI 060) and tihe process returns 
tostepS1020. 

FIG 11 is a flowchart specifically illustrating the process of executing the sHdeshow 
according to the present invention. Referring to FIG 11, the assets in the album are 
sequentially provided to the user. At this time, each of the assets can be defined beforehand 
for the transition for specifying how the next assets appear. The slideshow list is first 
initialized (SI 110). Then, MSTransitions' indicating the Ust of available transitions, 
Transind' indicating the current transition ID, 'arAlbumltem' indicating the list of the asset 
objects, 'i' indicating the index for the assets in the album, TransDur' indicating the transition 
duration, and T)isplayDuration' indicating the display duration for one asset are set (SI 11 5). 
Here, the data types of 'MSTransitions' and 'arAlbumltem' have the same structure as an 
array. After all parameters are set, the current asset is obtained (SI 120). It is then checked 
wheflier the current asset has a predefined transition (SI 125). If it is checked that the asset 
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has no predefined transition, a transition object is obtained by using Translnd* as a parameter 
(SI 130). To get the transition object for the next asset, the value of Transind* is increased by 
1 (SI 135) and the transition duration is set to be equal to TransDur* (SI 140). Thereafter, the 
transition is run (SI 1 70). On the other hand, if it is checked in step (SI 125) that the asset has 
a predefined transition, the predefined transition will have a higjier priority than parameters 
such as 'MSTransitions', Transind', *arAlbumItem', TransDuf and 'DisplayEhiration*. 
Transition description is located firom the database in which a variety of transition methods 
are stored (SI 145), and the transition type or transition sxibtype is then converted into a 
supported transition type (SI 150). The transition type so converted is defined as TransType'. 
Further, the predefined transition may contain information on the transition duration, which 
in turn is used as Tdur' (SI 155). After the transition object is initialized (SI 160) and the 
transition duration is set to be equal to TransDur* (SI 165), the transition is run (SI 170). Then, 
the value of 'i' is increased (SI 175). If the increased value of 'i' is smaller than the size of 
'arAlbumltem*, i.e. the number of the whole asset objects included in the album for providing 
tiie slideshow, the process will be moved or shifted to the next asset in the album and then 
returns to step S1120 (S1180 and S1185). If the value of T is equal to or higher than ttie 
value of 'arAlbumltem', the slideshow is stopped (SI 190). 

Industrial Applicability 

According to the present invention, a variety of multimedia data can be provided to 
the user and the user can manage and process the various multimedia data more efficiently 
by defining new concepts of multimedia data and providing the user with the multimedia 
data in various forms. 

Although the present invention has been described in connection with the 
embodiments of the present invention shown in the accompanying drawings, it is not limited 
thereto. It will be apparent to those skilled in Ihe art that various substitutions, modifications 
and changes may be made thereto without departing from the scope and spirit of the 
invention. 
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■ Remarks ■ 

1 . All of the documents will be sent to you via e-mail only. 

2. If the drawings are not sufficiently clear, please advise us. 

3. If you need anything further from us, please advise us. 

4. Maintain the instant application without our written instructions to the contrary. 
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